ROBOT TEACHING DEVICE 



BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to a teaching device for performing 
teaching operation of a robot and also a teaching modification device for 
modifying positions of taught points or orientation at the taught points in an 
operation program of the robot prepared by an off-line progra mmin g system. 

2 . Description of Related Art 

In preparing an operation program for an industrial machine such as a 
robot based on three-dimensional models of a robot, peripheral devices, an 
operation tool and an object of operation such as a workpiece using an off-line 
programming system, it is usual that there is a considerable error between an 
operation path according to the operation program and an intended operation 
path. Therefore, in practice, the prepared operation program is modified by 
successively positioning a distal end of an operation tool or a position 
correction tool on the worlq)iece (so caUed tough-up operation) in the real 
robot system. Further, there has been proposed a method of modifying 
position/orientation of models of a workpiece or peripheral devices prepared by 
the off-line programming system based on actual positions of the workpiece 
and peripheral devices detected by sensors in JP 2003- 1502 19 A. 

Further, it has been put into practice to detect three points defining 
position/orientation of the workpiece by sensors such as visual sensors to shift 
a taught path in the operation program. However, in this method adopting 
the visual sensors mounted on the robot, the visual sensor is moved by 
operating the robot manually using jog feed function of the robot on the 
try-and-error basis such that three points can be captured by the visual sensor. 

In the conventional techniques, in addition to preparation of an 
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operation program by the ofiF-line programming system at a place such as 
offices remote from a place of practice such as factory, arrangement and 
adjustment of operational machine such as robot, peripheral devices, sensors 
for detecting position/orientation of a workpiece are required, and further it is 
necessary to perform modification of the operation program by the touch-up 
operation or shifting of the operation path for conforming the operation path by 
the operation program prepared by the off-line programming with an actual 
operation path of the robot. Thus, it takes a considerable time for an operator 
to perform these cumbersome operations. 

SUMMARY OF THE INVENTION 

The present invention provides a teaching device capable of easily 
performing a teaching operation for teaching a robot of positions for 
performing an operation on an object, and also a teaching modification device 
capable of easily performing modification of positions of the taught points or 
orientations at the taught point for performing an operation on an object. 

According to one aspect of the present invention, the teaching device 
comprises: storage means storing positional relation between of the robot and 
the object; first displaying means for displaying a model of the robot on a 
display device movable around the object with an operator; specifying means 
for the operator to specify a direction of a present position of the operator with 
respect to the robot, referring to the model of the robot displayed on the display 
device; second displaying means for displaying a three-dimensional model of 
the object as viewed from the specified direction of the operator on the display 
device; and manual operation means for the operator to operate the robot for 
designating positions for performing the operation on the object, referring to 
the three-dimensional model of the object displayed on the display device. 

According to another aspect of the present invention, a teaching 
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modification device comprises: storage means storing positional relation 
among the robot, the object and the taught points; first displaying means for 
displaying a model of the robot on a display device movable around the object 
with an operator; specifying means for the operator to specify a direction of a 
present position of the operator with respect to the robot, referring to the model 
of the robot displayed on the display device; second displaying means for 
displaying a three-dimensional model of the object and the taught points as 
viewed fi^om the specified direction of the operator on the display device; and 
manual operation means for the operator to operate the robot for modifying 
positions of the taught points or orientations at the taught points, referring to 
the three-dimensional model of the object and the taught points displayed on 
the display device. 

According to still another aspect of the present invention, a teaching 
device comprises: storage means storing positional relation between of the 
robot and the object; first displaying means for displaying a model of the object 
on a display device movable around the object with an operator; specifying 
means for the operator to specify a direction of a present position of the 
operator with respect to the object, referring to the model of the object 
displayed on the display device; second displaying means for displaying an 
image of a three-dimensional model of the object as viewed fi-om the specified 
direction of the operator on the display device; and manual operation means for 
the operator to operate the robot for designating positions for performing the 
operation on the object, referring to the three-dimensional model of the object 
displayed on the display device. 

According to yet another aspect of the present invention, a teaching 
modification device comprises: storage means storing positional relation 
among the robot, the object and the taught points; first displaying means for 
displaying a model of the object on a display device movable around the object 
with an operator; specifying means for the operator to specify a direction of a 
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present position of the operator with respect to the object, referring to the 
model of the robot displayed on the display device; second displaying means 
for displaying a three-dimensional model of the object and the taught points as 
viewed from the specified direction of the operator on the display device; and 
manual operation means for the operator to operate the robot for modifying 
positions of the taught points or orientations at the taught points, referring to 
the three-dimensional model of the object and the taught points displayed on 
the display device. 

According to further aspect of the present invention, storage means 
storing positional relation among the robot, the object and the taught points; 
displaying means for displaying a three-dimensional model of the object and 
the positions of the taught points on a display device movable around the 
object with the operator; selecting means for the operator to select one of the 
taught points displayed on the display device; determining means for 
determining whether or not the selected taught point is visible wdthout 
interference on the display device in a direction of a present line of sight on the 
three-dimensional model; and altering means for altering the line of sight on 
the three-dimensional model on the display device such that the selected taught 
point is visible without interference in the direction of the altered line of sight 
when it is determined that the selected taught point is not visible on the display 
device by the determining means. 

At least a part of a model of a tool attached to the robot may be displayed 
on the display device with the three-dimensional model of the object, when the 
robot is operated such that the tool is located in the vicinity of the object. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic view of a teaching device according to an 
embodiment of the present invention; 
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FIG, 2 is a schematic diagram of software configuration in the 
embodiment; 

FIG. 3 is a schematic diagram of the teaching device in performing 
modification of taught points using a camera attached to a distal end of a robot 
arm; 

FIG. 4 is a flowchart showing an operation algorithm in the embodiment; 
FIG. 5 is a schematic diagram showing rotational shift of a view point; 
FIG. 6 is a flowchart showing an algorithm for calculating a vision-line 
vector. 

DETAILED DESCRIPTION 

FIG. 1 schematically shows a teaching device for performing teaching 
operation and also modification of taught positions according an embodiment 
of the present invention. A robot controller 1 coimected v^th a robot 4 
controls the robot 4 to operate respective mechanisms of the robot 4 such as 
robot arms in a conventional manner. A computer (a personal computer in 
this embodiment, which will be referred to as PC) serving as information 
processing device and a teaching pendant 2 are connected to the robot 
controller 1 through cables 5. The conmiunication between the robot 
controller 1 and the teaching pendant 2 and the PC 3 may be performed by 
communication using Ethemet (registered trademark) cables or RS-422 cables. 
In the case of adopting the Ethemet, the communication between the teaching 
pendant 2 and the PCS can be performed directly and in the case of adopting 
the RS-422, the communication between the teaching pendant 2 and the PC3 is 
performed indirectly through the robot controller 1. 

The teaching pendant 2 has a display section 2a constituted by a display 
device such as a Uquid crystal display and an input operation section 2b 
constituted by soft keys and keys for inputting various command and data. 
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The teaching pendant 2 is portable to be movable around an object of operation 
with an operator. In the input operation section 3b, there are provided keys 
for commanding a start and a stop of simulation of an operation of the robot, 
operation mode switches for selecting outputting of motion commands for the 
robot to the servo controller for drivingly controlling servomotors for 
respective axes, to the PC 3, or to both of the servo controller and the PC 3, 
display condition altering keys for altering data on display condition of 
animations stored in the PC 3, and operation mode selecting switch for 
selecting operations regarding the simulation at the teaching pendant 2, at PC 3, 
or at both of the teaching pendant 2 and the PC 3 . 

The PC 3 have a display section 3a and an input operation section 3b such 
as a key board likewise a conventional personal computer, and there are 
provided keys for commanding a start and a stop of the simulation, operation 
mode switches for selecting outputting of the motion command to the servo 
controller, to the PC 3, or to both of the servo controller and the PC 3, and 
operation mode selecting switch for selecting operations regarding the 
simulation at the teaching pendant 2, or at PC 3, or at both of the teaching 
pendant 2 and the PC 3. 

FIG. 2 is a functional block diagram representing functions of the robot 
controller 1, the teaching pendant 2 and the PC 3 achieved by software 
processing. 

In the robot controller 1, there are provided a communication interface la, 
a software function lb for execution of a program, a motion section Ic for 
creating operation position information of the robot based on the program 
execution, a servo control section Id for drivingly controlling servomotors for 
respective axes of the robot 4, a servo delay model le for obtaining information 
on an operation position for the animation with a servo delay compensated, an 
interface If for the teaching pendant (TP), and an editor Ig, ect.. 

The teaching pendant 2 is provided with a program 2c for user interface. 
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an emulator 2d for user interface, a software 2e for browser, etc. The PC 3 is 
provided with a communication interface 3c, a graphic animation section 3d, 
and an emulator 3e for the teaching pendant. 

In the example shown in FIG. 2, the robot controller 1, the teaching 
pendant 2 and the PC 3 are connected by the Ethemet cable 5. 

FIG. 3 schematically shows an example of an operation of modification of 
taught points with respect to a part 10 as an object of operation by the robot 
using a CCD camera 6 as a visual sensor attached to a distal end of an arm of 
the robot 4. As shown in an enlarged view A of the display section 2a of the 
teaching pendant 2, a plan view and a side view of a layout of the robot system, 
and a model of the object of operation and a part of the robot system are 
displayed in the display section 2a . 

The system layout constituted by three-dimensional models of the robot, 
peripheral devices, an object of operation, and an operational tool are prepared 
in advance by the off-line programming system. The three-dimensional 
models of the peripheral devices and the object of operation may be prepared 
in the teaching pendant using two-dimensional graphic data prepared by a 
CAD device. The three-dimensional models of the robot and the tool are 
prepared using the graphic data stored in the storage device. 

Then, points for the robot operation are taught in the off-line 
programming system to create an operation program of the robot. 
Confirmation of the robot operation is performed by the simulation and the 
confirmed operation program is used for apphcation in the operation place such 
as factory. In the confirmation, the three-dimensional models of the robot, the 
peripheral devices, the workpiece and the tool are arranged on the display 
device 3a of the PC 3. It is expected that the layout of the respective models 
on the display device 3a approximately correspond to a real layout of the 
corresponding elements (the robot, the peripheral devices, the workpiece and 
the tool) or dummies of these elements. 
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However, in the actual cases, the layout on the display device 3 a may be 
displaced from the actual layout because of errors in data, adjustment of the 
actual layout in the factory, etc. The present invention enables easy 
correction of the displacement between the layout of the models and the actual 
layout of the corresponding elements. 

FIG. 4 shows modification processing of the positions of the taught points 
and/or orientations at the taught points according to the embodiment. 

First, the layout of the models of the robot, the object of operation, and the 
peripheral devices which are stored in the PC 3 is displayed on the display 
section 2a of the teaching pendant 2 (Step 100). Specifically, a plan view of 
the robot system is displayed in a plan-view area of the display section 2a, a 
side view of the robot system is displayed in the side-view area of the display 
section 2a, and three-dimensional models of the object withe the taught points, 
and a part of the robot system in the vicinity of the object are displayed in the 
object display area of the display section 2a. 

Then, an operator inputs a present position of the operator to specify a 
direction of the operator with respect to the robot (Step 101). Specifically, the 
operator specifies a place where the operator presently exists by moving a 
cursor to a position where the operator exists in the plan-view area and the 
side-view area in the display section 2 a and clicks the set button, to designate 
the direction of the operator with respect to the robot. With this operation, a 
position of a view point is determined by the direction of the operator with 
respect to the robot. Then, the operator designates a taught point in the object 
display area (Step 102). When the operator clicks the execute button to start 
automatic calculation of a line-of-sight vector, a three-dimensional model of 
the object as viewed from the present view point of the operator is displayed in 
the object display area of the display section 2a (Step 103). In this processing, 
if the designated taught point is not visible from the view point of the operator, 
a three-dimensional model of the object as viewed form a view point where the 
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designated taught point is visible without obstacles. The automatic 
calculation of the line-of-sight vector will be described later in detail. 

Then, the operator operates the robot so that the designated taught point is 
captured within a field of view of the camera 6 (Step 104), and an image of the 
object captured by the camera 6 is displayed at the object display area to be 
overlapped with the model of the object (Step 105). Then, the operator moves 
the designated taught point in the object display area to an intended position for 
the taught point in the image of the object, and chck the set button so that the 
position of the taught point is stored as a modified position of the designated 
taught point (Step 106). 

Altematively to or in addition to the above procedure, a distal end of an 
operation tool or a position correction tool attached to the robot may be 
positioned at the intended point for the taught point, to modify the position of 
the taught point in the operation program using coordinate values of a control 
point of the robot. 

The above processing is performed on the taught points to be modified in 
the robot operation program prepared by the off-line programming system. 
Thus, the taught points prepared by the off-line programming system are 
modified to cancel the displacement between intended positions for performing 
an operation on the object and the taught positions for the operation in the 
robot operation program. 

The processing for automatic calculation of the line-of-sight vector in 
Step 103 in FIG. 5 will be described in detail referring to FIG. 6. 

The position of the operator is calculated based on the specified position 
of the operator in the plan-view area and the side-view area (Step 200). 
Then, the position of the taught point to be modified designated by the operator 
is calculated (Step 201), and a line-of-sight vector fi-om the view point as the 
specified position of the operator to the designated taught point (Step 202). A 
rotational angle a for changing the view point is set and a register R for storing 
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the rotational angle is cleared to "0" (Step 203). 

Next, it is checked whether or not the line-of-sight vector from the view 
point to the designated taught point interferes with components in the system 
layout (Step 204). Specifically, it is checked whether or not the taught point 
is visible from the view point without interference with the components. * If it 
is determined that there is any interference, an alert and a message to prompt 
the operator to input a command for recalculation of the line-of-sight vector is 
displayed on the display section 2a of the teaching pendant 2 (Step 206). 

When a command for recalculation of the line-of-sight is inputted, the set 
rotational angle a is added to the value of the register R to be accimiulated 
(Step 208), and it is determined whether or not the value of the register R 
exceeds 360"^ (Step 209). If the value of the register R is less than 360°, a 
position rotated by an angle obtained by adding the angle a to the set angle is 
set as a new view point (Step 210), In this processing, a new view point is 
determined by calculating a position to rotate the line-of-sight vector by the 
angle +a in a direction of a latitudinal or longitude line of a sphere having a 
radius from the view point to the designated taught point, as shown in FIG. 5. 
Then, the procedure returns to step 204 and repeatedly executes the foregoing 
processing. 

If it is determined that the value of the register R is not less than 360° in 
Step 209, it is deemed that the designated taught point can not been seen from 
this position without obstacles even if the view point is changed, and an alert is 
issued (Step 212). The reference value in the determination in Step 209 may 
not be necessarily set to 360°. In this embodiment, the reference value is set 
to 360° with safety margin. 

Thus, the view point at which the operator can see the designated taught 
point without obstacles is determined and the procedure proceeds from Step 
205 to Step 211. At Step 21 1, a renewed image of the object as viewed from 
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the determined view point is displayed at the object display section. In the 
object display screen, the tool attached to the distal end of the robot arm is 
displayed in the field of view of the object display section if the tool is withing 
the field of view. 

With the above procedure, the view point where the operator can see the 
designated taught point without obstacles is determined, and the model of the 
object as viewed firom the view point is displayed at the object display section, 
the position/orientation of the designated taught point is corrected by 
performing the processing of Step 105 and the subsequent Steps in FIG. 4. 

In the foregoing embodiment, the direction of the operator with respect to 
the robot is specified by inputting a position of the operator on the plan view 
and the side view of the robot layout in the display section 2a of the teaching 
pendant 2. The direction of the operator with respect to the object may be 
specified by inputting a position of the operator on the plan view and the side 
view of the object of operation in the display section 2a of the teaching pendant 
2. 

Further, the modification processing of positions of the taught points 
and/or orientations at the taught points is described in the foregoing 
embodiment. An teaching operation for designating positions for performing 
the operation on the object by the robot may be performed by an operator to 
manually operating the robot referring to the three-dimensional model of the 
object displayed on the display section 2a of the teaching pendant 2. 

According to the present invention, position of a point to be taught or the 
taught position to be modified with respect to an object of operation is 
sentientiy and easily recognized by an operator by referring to the 
three-dimensional models as viewed form a direction of a line-of-sight of an 
operator displayed on the display device of the teaching pendant. 
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